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ABSTRACT 
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that adopts a real world metaphor. In particular, the user 
interface appears to a user as containing rooms of a home. 
The user can specify what rooms are to be included in the 
home and can specify the style of the appearance of the 
rooms of the home. The user interface serves as a vehicle for 
the user to invoke applications and perform tasks. The user 
interface also generates a personal character for each user. 
The personal character is an animated guide that helps to 
assist the user in using the computer. Specialized characters 
may also be provided to perform specialized tasks. 
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SOFTWARE PLATFORM HAVING A REAL having a video display and a character editor. In the method, 

WORLD EVTEREACE WITH ANIMATED the character editor is used to interactively create a personal 

CHARACTERS character for a user. The character created using the char- 

acter editor is displayed on the video that is displayed to 
This application is a continuation of 08/272,691, filed 5 assist the user in using the data processing system. 
Jul. 8, 1994, now U.S. Pat. No. 5,682,469. BRIEF DESCRIPTION OF THE DRAWINGS 

TECHNICAL FIELD FIG. 1 is a block diagram of a data processing system that 

is suitable for practicing a preferred embodiment of the 
The present invention relates generally to data processing present invention, 
systems and, more particularly, to software development F^G- 2 is a diagram of a contemporary style study as 
platforms in data processing systems. provided by the preferred embodiment of the present inven- 

tion. 

BACKGROUND OF THE INVENTION FIG. 3 is a diagram illustrating an example specialist 

. 1 r , character in an application program according to the pre- 

Many conventional software products provide user inter- 15 j^^^^ embodiment of the present invention, 
faces that are diflacult to use. These user mterfaces are r^ir^ ^ • j- -n * r i 

particularly difficuh for novice users to use. Such novice ^, ™- ^ " "^'^^'^"^ lUustratmg the components of a data 
users often feel intimidated by the user interfaces. for a character m accordance with the preferred embodi- 

Unfortunately, a user must typically undergo extensive train- P'^"^"^ invention. 

ing before he feels comfortable using the user interfaces of 20 ^ ^ ^ diagram of an example of the user interface 

such software products, provided by the preferred embodiment of the present inven- 

tion to enable a user to select a personal character. 
SUMMARY OF THE INVENTION FIG. 6 is a flow chart of the steps performed by the 

^ , ^ . . ^ preferred embodiment of the present invention to create a 

The shortcomings of the user interfaces of the prior art are jj^^ character. 



overcome by the present invention. In accordance with the 7 ^ ^. ^ .^^^ ^ j 

fiKt aspect of the present invention, a method is practiced in .^aracter editor of the prefe^ed embodiment of the present 

a data processing system havmg a video display, a storage invention 

for storing computer programs, a processor for running the r:,^ o - j- n . .• , j ,• 

computer programs and a system level service for displaying * ? » ^'"Sram dlustratmg an exemplary video frame 

at least one animated character on the video dispky. TTie '° "^^l?^ ''^ »°"nation m accordance with the preferred 

. , J 1- ■ 1 embodiment of the present mvention. 

computer programs include an apphcation program and a t^t^ . "Ti ^ "jvt^uuuu. 

program for displaying a system user interface from which , ^ ^ ^^^""^ diagram illustratmg the interaction 

the application program may be invoked. In accordance with ^'^^^^^ \° application, a speech balloon service and the 

this method, the program for displaying the system user character data file in obtaming a vocabulary snippet in the 

interface is run on the processor. While the program is run, Preferred embodiment of the present invention. 

an animated character is displayed on the video display via ^ ^^^^ illustrating the steps performed by 

the system level service. Assistance is provided to the user preferred embodiment of the present invention to obtain 

via the animated character. When running the appUcation display a vocabulary snippet in a speech balloon. 

program on the processor, the animated character is dis- FIG. lOA is a block diagram illustrating the interaction 

played on the video display via the system level service. between an application, a tracking service and a tip service 

Assistance is provided to the user via the animated character. deciding whether to display a tip in the preferred embodi- 

In accordance with an additional aspect of the present "'^"^ P'^^^^* invention. 

invention, a method is practiced in a data processing system . ^ ^^^^t illustrating the steps performed 

having a processor for running computer programs, storage ^° deciding whether to display a tip in the preferred embodi- 

for storing the computer programs and a video display. In present invention. 

this method, a current user is provided with a selection of FIG. 11 A is a block diagram illustrating the interaction 

personal characters from which the user may choose. In between an application, actor services and the character data 

response to a choice by the user of a desired personal playing an animation in the preferred embodiment of 

character, a character selected by the user is assigned to the ^he present invention. 

user. Whenever any of the computer programs are run, the FIG. IIB is a flow chart illustrating the steps performed 

desired personal character is displayed on the video display in the preferred embodiment of the present invention to play 

for the current user and assistance is provided to the current an animation. 

user through the personal character. FIG. 12 is a flow chart illustrating the steps performed 
In accordance with another aspect of the present 55 ^1^^" ^ known user attempts to log on in the preferred 

invention, a method is practiced in a data processing system embodiment of the present invention, 

having a video display. In this method, an animated personal FIG. 13 is an example of an outside screen used in the 

character is provided for a user. The animated personal preferred embodiment of the present invention, 

character is displayed on the video display to assist the user FIG. 14 is a flow chart illustrating the steps that are 
in using the data processing system, A specialized task is go performed when a new user attempts to log on in the 

invoked within the data processing system. When the spe- preferred embodiment of the present invention, 

ciahzed task is invoked, the personal character is replaced FIG. 15 is a diagram fllustrating exemplary layout for the 

with an animated speciaHzed character. ITie animated spe- rooms of a home in accordance with the preferred embodi- 

cialized character is displayed on the video display and ment of the present invention. 

provides assistance to the u.ser for the specialized task. 55 FIG. 16 is an example of a caslle-style study generated in 

In accordance with a still fairther aspect of the present accordance with the preferred embodiment of the present 

invention, a method is practiced in a data processing system invention. 
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FIG. 17A illustrates the appearance of graphical objects in is a named set of logically-related functions that allow, for 

a room when a contemporary style is chosen for the room in example, a user to access the services 26 and applications 

accordance with the preferred embodiment of the present 20. An interface lists signatures, such as parameters, for a set 

invention. of functions. An interface does not provide code for imple- 

FIG. 17B is a diagram illustrating graphical objects for a 5 menling functions; rather, the code for implementing func- 

room when a space-style is chosen for the room in the Uons is provided by objects. Objects that provide the code 

preferred embodiment of the present invention. for implementing such functions of an interface are said to 

DETAILED DESCRIPTION OF THE "support" the interface. The code provided by an object that 

INVENTION supports an interface must comply with the signatures that 

Apreferred embodiment of the present invention provides ^° interface definition. In the C++ program- 

a software development platform that provides a friendly language, an mterface is a set of virtual functions, 

and intuitive user interface. The user interface provided by The services 26 provide functionality that may be called 

the software development platform adopts a real world by clients, such as applications 28 or the shell 30. In the 

metaphor so that it is readily recognizable to users and not preferred embodiment of the present invention, the services 

intimidating to novice users. The user interface helps to 26 are implemented as OLE 2.0 component objects. They 

minimize the time required to learn to use the computer and provide services to clients by making instances of interfaces 

also helps to demystify the computer to novice users. The (that they support) available to clients. Component objects 

user interface presents the user with an environment that are described in more detail in "Inside OLE 2," by Kraig 

resembles rooms of a house and provides each user with a Brockschmidt, Microsoft Press, 1994, Examples of what is 

personal character that serves as a guide and assistant, a service 26 will be given below. 

FIG. 1 is a block diagram of a data processing system 10 The applications 28 are oriented to specialized tasks 

that is suitable for practicing the preferred embodiment of rather than to generalized functions. For example, in some 

the present invention. The data processing system 10 implementations, the applications 28 may include a letter 

includes a central processing unit (CPU) 12 for controlling writer for writing letters and a resume writer for writing 

operation of the data processing system 10 and a number of resumes rather than including a word processing application 

peripheral devices, including a keyboard 14, a video display for performing both such tasks. The task-oriented nature of 

16, an audio output device 17, a mouse 18, a secondary the applications 28 makes it eaisier for the user to decide 

storage device 20, and a memory 22, which application to use to perform a given task. 

Those skilled in the art will appreciate that the data The applications 28 are developed to encourage personal 

processing system 10 of FIG. 1 is intended to be merely interaction between the user and characters. As will be 

illustrative and that the present invention may also be described in more detail below, the characters serve as 

practiced in other environments, such as in an electronic assistants that aid the user in performing tasks. The charac- 

wallel or an intelligent television set. ters are designed to encourage social interaction with the 

The memory 22 holds the software development platform user. The applications 28 interact with the user via the user 

24 of the preferred embodiment of the present invention. interface elements, such as the personal character, that are 

The software development platform 24 includes three modu- also utilized in the shell. The applications 28 appear in the 

larized components: services 26, applications 28 and a shell shell 30 as objects that can be organized, modified or 

30. Iliese three components 26, 28 and 30 will be described launched. The applications 28 take advantage of the services 

in more detail below, 40 provided by the software development platform 24 to 

The software development platform 24 may be viewed as present the user with a consistent and readily recognizable 

a hybrid between an operating system and a software suite. user interface. 

It provides functionality that resembles an operating system The shell 30 is analogous to an operating system shell, 

through the services 26 and the shell 30. On the other hand. The shell 30 provides a user interface to the user that allows 
the software development platform 24 provides functional- 45 the user access to the applications 28 and services 26. As was 

ity that resembles a suite in that it provides a number of mentioned above, the shell 30 provides a user interface that 

different applications 28 to the user. has a real world metaphor. The user interface resembles one 

Those skilled in the art will appreciate that the present or more rooms of a house. Each room contains objects that 

invention may be practiced on data processing coiifigura- may be manipulated to perform a desired task. The objects 
tions that differ from that depicted in FIG. 1. The data 50 are intuitively assigned to assist the, user in performing 

processing system depicted in FIG. 1 is intended merely to tasks. For example, to invoke a calendar program, the user 

be illustrative. Those skilled in the art will also appreciate merely needs to double-click the mouse 18 on a graphical 

that the services 26, applications 28 and shell 30 may be calendar object that has the appearance of a calendar, 

implemented in a number of different ways, including as In order to understand the user interface provided by the 
objects that comply with the component object model set 55 shell 30, it is helpful to examine an example. The user 

forth in the OLE 2,0 protocol of Microsoft Corporation of interface includes two primary elements: characters and 

Redmond, Wash. rooms. FIG. 2 shows an example of a room 32 that is 

In order to fully understand the preferred embodiment of provided by the shell 30. The room 32 is a screen that is 

the present invention, it is helpful to first introduce a few displayed on the video display 16. The room 32 shown in 
relevant concepts. One such concept is the notion of an 60 FIG, 2 is one of many rooms that may be provided the shell 

"object". An object is a logical structure that includes data 30. The user interface shown in FIG. 2 also includes a 

structures for holding data. An object may include functions personal character 34 that provides the user with assistance 

that operate on the data held in the data structures. An object, in using the data processing system 10. 

in some instances holds only data and does not hold any The use of characters within the preferred embodiment of 
functions. 65 i^e present invention and the use of the interface that 

Another concept that is utilized in the preferred embodi- resembles one or more rooms of a home in the preferred 

ment of the present invention is an "interface". An interface embodiment of the present invention will be described in 



05/25/2004, EAST Version: 1.4.1 



us 6,388,665 Bl 

5 6 

more detail below. The discussion initially focuses on the cialist character is generally created and controlled by an 

use of characters and then later focuses on the use of the application 28. 

interface that resembles rooms of a house. ,n alternative embodiment, the personal character is 

Each user is assigned a "personal character." ITie char- not replaced but. rather, the appearance of the personal 

acteris personal m that it is assigned on a per-user basis. 5 character changes. For example, if the user invokes a 

Nevertheless, different users may be assigned a same per- spreadsheet program, the personal character might don a 

sonal character. The user may choose a personal character or ^.^..v™ .-u u- w 1 ju ui ti.u 

have a default personal character assigned. The sheU 30 S^en visor, change his vocabulary and be more helpful than 

provides a user interface that allows a user to choose a ^^^^ * 

personal character or change a personal character. The ^^^^ character (e.g., each personal character or each 

personal character provides the user with a tool that assists specialist character), the software development platform 24 

the user in performing tasks. The user interacts with the ^^^''^^ ^ ^^^^ ^^^^ describes critical characteristics of 

personal character in a social fashion as if the character were ^^e character. Those skilled in the art will appreciate that the 

another person. The personal character of a user is continu- ^^^^ multiple files rather than a single file, 

ously present (except in a few instances) to help the user in 33 ^^^^ stored in the data file 39 is used to generate actions 

performing tasks. Examples of actions that the personal character, as will be described in more detail below, 

character may perform include personally greeting a user, ^ iUustrates the major types of data that are stored in 

telling the user what the user can and cannot do, providing ^^^^ ^^^h character. In the preferred 

expertise on matters related to using the computer and embodiment, each instance of a character is an object that 

informing the user of important events and engagements, ^^PP^*"^ interfaces for performing tasks. Application pro- 

As shown in FIG. 2, the personal character 34 is consis- S'^™ interfaces (APIs) are provided to aUow applications 28 

tently shown on the video display 16 in the lower right-hand ^^^^ characters. Those skilled in the art wiU apprc- 

corner in the preferred embodiment of the present invention. ^^^^^ ^^^^"^ ^^Pes of data may also be stored m file 39. 

Alternatively, the personal character may move about the ammations 40 that may be performed by the characters are 

screen in some embodiments of the present invention. .5 ^'^^^^ ^ metafiles or bitmaps m the data file 39. For 

Moreover, in some alternative embodiments, the personal example, an anunation illustratmg the personal character 

character may appear and disappear based on user actions or Ji^mping up and down, an animation illustrating the charac- 

system events. The personal character 34 often provides sleeping and an animation illustratmg the character 

assistance to the user by displaying speech balloons (see P^^"^S "^^y ^ ^° ^^^^ 

balloon 35 in FIG. 2). The speech balloons present the user 30 Vocabulary data 44 is also stored in the file 39. The 

with text that contains helpful information and/or controls vocabulary data 44 is a table of vocabulary snippets that may 

that allow the user to perform tasks. For example, speech "sed to form text contained within character speech 

balloon 25 includes the text: "Greetings, Sam", the "Start an balloons. Examples of vocabulary snippets include a snippet 

activity" button control and the "Other options" button character's name, a snippet for introducing the 

control. Alternatively, the speech balloon may include text 35 character, a snippet for greeting a user, a snippet for pro- 

but not controls. The controls may be relegated to a separate viding a farewell and a snippet for sounding an alarm. Those 

menu or other user interface element. skilled in the art will appreciate that other snippets may also 

Each personal character may perform a number of differ- 5^°^^^ ^ vocabulary data 44. All characters need not 

ent animations. Each personal character has its own "per- ^ave the same vocabulary. In fact, preferably, each character 

sonahty" that is reflected in its animations. The personality 40 ^ unique vocabulary. 

of the character is also reflected in the contents of its speech History data 46 is stored for each character. The history 

balloons and generally in its interactions with the user. At ^ata 46 includes a snapshot of the character and personal 

any point in time a user may replace a personal character information. The snapshot is a bitmap or metafile that 

with another personal character whose behavior and person- depicts the character. The personal information includes the 

ality are more to the liking of the user. 45 name, sex, hometown, a helpfulness index (in the range of 

"Specialist characters" are also provided in the preferred ^) attributes. The helpfulness index is a quan- 

embodiment. SpeciaUst characters are simHar to personal ^^^^^i^e value that indicates how likely the character is to 

characters, but specialist characters appear only when the provide instructions to the user. Certain characters are 

user is performing a specialized task. Each specialist char- designed to be more helpful than others, as reflected in larger 

acter has a personality and a demeanor that is weU suited for 50 ^^lues for their helpfulness indices. Characters with differ- 

its specialized task. Moreover, its vocabulary is especially degrees of helpfulness are provided to belter suit the 

adapted for the task at hand and it may have a greater "^^^^ personalities of users. 

helpfulness index to provide the user with a greater amount Lastly, code 50 may be stored in the data file 39. The code 

of assistance than the personal character. The specialist 50 provides added functionality for the character. The code 

character is an expert that helps the user to better perform a 5S 50 is optional and is used to enhance the capabilities of the 

critical specialized task. For example, FIG. 3 shows an character. For example, code may be provided to track user 

example of a plant specialist character 36 who appears in a actions. By tracking user actions, the character is more likely 

gardening application program. She provides advice and to be able to anticipate a user's needs and to help the user 

options via speech balloon 37. A specialist character may avoid common pitfalls. In addition, the code 50 may provide 

have greater credibility and is provided to gain the trust of 60 added functionality, such as voice recognition, voice acti- 

the user in performing a specialized task. A specialist vation and other intelligence that enhances the capabilities 

character replaces the personal character of a user when the of the character. 

specialized task is to be performed. When the specialized The software development platfonm 24 provides a user 

task is completed, the personal character returns to replace with a choice from a number of different personal characters, 

the specialist character, llius, a user may have available a 65 The shell 30 provides a dialog that allows the user to select 

whole family of characters that include his personal char- the personal character that the user desires. FIG. 5 illustrates 

acter as well as a number of specialist characters. A spe- an example of the user interface that is provided for selecting 
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a personal character. The user interface is organized as a 
photo- book, where each page shows the snapshot of the 
character and information about the character. Speech bal- 
loons are provided that have controls for selecting or reject- 
ing the viewed character. 

The software development platform 24 also provides a 
character editor as part of the services 26 that allows a user 
to create new characters. FIG. 6 is a flow chart showing the 
steps performed to create a character using the character 
editor. FIG. 7 shows an example screen shot of the character 
editor in use. Initially, the user must create cast members 
(i.e., generate bitmaps for the cast members) or locate a file 
that holds cast members (step 52 in FIG. 6). Cast members 
are the graphical pieces of a character. For example, the cast 
members of a dog personal character (labeled 20-39) are 
shown in FIG. 7. Cast members, the various parts of the dog, 
include the dog*s head, eyes and snout (cast members 
20-22) and the dog's eyes (cast members 23-28). These cast 
members are stored as either bitmaps or metafiles. In the 
preferred embodiment of the present invention, the cast 
members are stored as metafiles to minimize memory 
requirements for the cast members and animations, and to all 
smooth display at differing resolutions. 

Once the user has provided cast members, the cast mem- 
bers are imported into the character editor (step 54 in FIG. 
6). This allows the character editor to gain access to the cast 
members. The character editor is then used to create a rest 
pose frame from the cast members (step 56). The rest pose 
frame is an animation frame showing the character at rest. 
Each animation begins and ends with such a rest pose frame. 

The character editor is also used to produce animations 
which include collections of video frames thai are played in 
order to create the illusion of movement by the character. 
Each frame holds the video data necessary to display the 
character in a given position. Sound may be added to the 
animation. For example, in FIG. 7 the character editor is 
being used to create frame 3 of an animation. The sound is 
stored in separate sound frames. The sounds are stored as 
waveforms that may be replayed along with the sequence of 
video frames. Alternatively, voice synthesis techniques may 
be employed to generate sound. 

FIG. 8 shows a sequence of video frames 78, 80, 82 and 
84 that are part of an animation for the dog personal 
character. Although the animation that is shown in FIG. 8 is 
two dimensional, those skilled in the art will appreciate that 
the characters may also have three-dimensional animations. 
Once a rest pose frame has been created (step 56), the cast 
members are used to create the remaining frames of the 
animation (step 58). As can be seen by examining FIGS. 7 
and 8, the rest pose frame 78 was created using cast 
members. Similarly, frame 80 is created using other cast 
members. For personal characters, a separate animation is 
provided for each designated action that the character may 
perform or for each command to which the character is 
responsive. 

Once the animations are created (step 58), the history data 
46 is interactively obtained from the user for the newly 
created character. The character editor provides edit boxes to 
edit the personal information stored in the history data 46. In 
addition, the snapshot of the character stored in the history 
data 46 may be manipulated so as to specify a metafile or a 
bitmap that holds as the snapshot of the character. 

The vocabulary data 44 of the character is then interac- 
tively obtained from the user (step 62). Lastly, the obtained 
data is saved in the data file 39 for the character (step 64). 

'l^e vocabulary data 44 stored in the data file 39 is used 
to display text within a speech balloon of a character. A 
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Speech balloon service is provided as part of the services 26 
(FIG. 1) of the software development platform 24. The role 
of the speech balloon service is to retrieve vocabulary 
snippets from the vocabulary data 44 held within the data file 
5 39. The retrieving of vocabulary snippets will be described 
in more detail below relative to FIGS. 9A and 9B. The 
retrieved snippets may also act as input to a voice synthesis 
portion of the system that produces corresponding audio 
output. 

10 Vocabulary snippets are provided for a number of differ- 
ent purposes. Each purpose has an associated snippet name. 
For each snippet name, there may be up to 30,000 snippets 
provided. For example, the exclamation snippet name may 
include "On my!", "Wow!" and "Excellent!" as snippets, 

15 which express a character's excitement. The snippets stored 
under each snippet name are indexed to permit easy access. 

System services that are provided as part of the services 
26 draw the speech balloon at the request of an application 
28. The contents of the speech balloon (i.e., the text and 
controls contained therein) are the responsibility of the 
application. FIG. 9B shows a flow chart of the steps per- 
formed by an application to obtain a text snippet. Initially, 
the application 28 (FIG. 9A) sends a request 88 for a snippet 
by name to the speech balloon service 86 (step 94 in FIG. 
9B). As there may be multiple snippets stored for the 
requested snippet name, the speech balloon services 86 must 
decide which snippet to retrieve from the character data file 
39 (step 96 in nG. 9B) The speech balloon service 86 may, 
for example, use a weighted random method to determine 
which snippet to retrieve. For example, a random value may 
be generated. The random value is then used as an index for 
retrieving a snippet 92 amongst those stored under the 
snippet name. Thus, for instance, the snippet used to express 
character excitement varies so as to make interaction with 
the character more interesting. 

The indexed snippet 92 is then retrieved from the char- 
acter data file 39 by the speech balloon service 86 (step 98 
in FIG. 9B). The speech balloon service 86 forwards the 
snippet 92 to the application 28 (step 100 in FIG. 9B). The 
application 28 displays the snippet in a speech balloon (step 
102 in FIG. 9B). 

The speech balloons displayed by the preferred embodi- 
ment of the present invention may include tips. Hps are 

45 useful information provided by a character to assist the user 
in performing a task. Typically, a tip is displayed when a user 
does something wrong. Tips may, however, be triggered by 
other events to help the user avoid this pitfall in the future. 
To provide such lips, the preferred embodiment includes a 

50 tip service 104 and a tracking service 105, as shown in FIG. 
lOA. The tip service 104 and the tracking service 105 are 
part of the system services 26 and interact with the appli- 
cation 28 to guide the application in deciding when to 
provide tips. The tip service 104 has access to a number of 

55 tips 103 for which it may display. The tips are stored in data 
structures that are provided from the application 28 when it 
is initially loaded. 

A separate data structure is stored for each tip. The data 
structure holds the number of lives for the tip, the sensitivity 

60 index of the tip (0-48), an identifier for the tip and a 
specification of how to display the tip. The sensitivity index 
specifies some measure of how frequently the user must 
perform a triggering event before a tip will be displayed. The 
sensitivity index reflects an empirically derived estimate of 

65 how frequently a tip should be displayed based on the 
number of occurrences of a triggering event. The sensitivity 
index is used along with the helpfulness index of the 
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personal character to determine when a tip is to be displayed. to actor services 112 to request that the character perform a 

This calculation will be discussed below. The number of particular action (step 116 in FIG. IIB). The actor services 

lives value stored for a tip specifies how may times a tip will 112 consult a table 113 that associates commands with 

be displayed before it will no longer be displayed. animations. In particular, the table 113 tells the actor ser- 
The tip service 104 is responsible for retrieving the tip and 5 vices 112 what animation to retrieve for the given command 

providing the necessary information to display the tip in a services 112 then retrieves the animaUon that 

speech baUoon. The tracking service monitors user activities js appropriate for the command 114 (step 117 in FIG. UB) 

to determine when to display the tip. J^^ P'*^^^ .^?}.°' ^'^'"''^ 

■ 171 r- IAD • a iT . 11 . .u (step 118 m FIG. IIB). The actor services 112 mcludetmjing 

RG. lOB is a flow chart illustraUng the steps ha are „,echamsms that aUow the animation to be played properly 

performed to determine whether to display a tip. Initially a i„ ^ ^^^^ ^ provided and 

user performs a tnggermg event (step 106). For example, ^^ ^^ ^ ^^J^ ^^^J^^ ^^^^ 

suppose that a user is typmg a word processing document be played. The actor services calculate which frame to 

and manually mser^s carnage reUirns when the word pro- „e^t display and set the timer accordingly. 

^TenteTnrnT Ti^.T'""^ '"f" 'u^T^' 15 ^h'^ ""i^^'^n^ ^0 Stored within the data file 39 includes 

The entering of a nnanual carriage return by the user is a , • ^ u a j ■ ■ r 

triggering event frames as well as duration and timing information. 

1- -^o L ,1 . ^ The animations 40 also may include audio information and 

Ihc apphcation 28 then tells the tracking service 105 of conditional branching information. The conditional branch- 

the occurrence of the triggering event (step 107). As was i^g information allows the play sequence of frames to vary 

mentioned above each Up stores a value that specifies the u^der certain conditions, the frames are played at a 

number of hves of the tip. Each time that the user performs different sequence than they are normaUy played. The idea 

the correct action (i.e., an action that if performed incor- behind the conditional branching is to make sure that the 

rectly would trigger a tip), the number of hves is decre- same animation is not played repeatedly. The conditional 

mented by 1. In addition, when the tip gets displayed, the branching mechanism uses a random number generator that 

number of lives is also decremented by 1 Before a tip may generates a random number in the range 0^000 in hexa- 

be displayed, a determination is made whether the number decimal notation. The range of possible values of random 

of hves IS greater than 0 (step 108) . If the number of hves number is divided into subranges, wherein each subrange is 

IS greater than zero the trackmg service 105 decrements the associated with a corresponding branch. The size of the 

count It mamtams (step 109). ^^brange depends on the probability that the associated 

In contrast, if the number of lives is less than or equal to branch will be taken. Thus, for example, a branch with an 80 

0, the tip is not displayed, because the number of lives have percent probability of occurring is assigned a subrange that 

been extinguished. The number of lives can be incremented constitutes 80 percent of the range between 0 and 8000 

or reinitialized. For example, the number of lives may be (hex). It is then determined which subrange the random 

reinitialized periodically if the user has not used the system number falls in, and the associated branch for the subrange 
or if the tip has not been displayed for a predetermined 3^ is played at the point of the conditional branch, 

period of time. -j^^ conditional branching is particularly useful for the 

For each user and tip pair, a separate count is maintained. idle animation. The idle animation is displayed whenever no 

The count is initially set equal to the sensitivity index and is other commands have been send to the actor services 112. It 

decremented by the helpfubess index of the personal char- should be appreciated that the idle animation may be 

acter each time that the triggering event occurs. For instance, requested by applications 28 and by the shell 30. More 

suppose that the sensitivity index for a tip is "18" and the generally, the application 28 shown in FIG. IIA and the 

helpfulness index for the personal character is "6". Each appUcation28shown in FIG. 9Amay bethe sheU30orother 

time the triggering event occurs, the count is decremented by applications. Since the idle animation is shown so 

frequently, the conditional branching is desirable within the 

Whenever the count is decremented, the tracking service 45 idle animation to vary the animation sequence that is shown 

105 checks whether the count is less than or equal to 0 (step to the user. 

110). In the example given above, the third time the trig- In the preferred embodiment of the present invention, 
gering event occurs, the sensitivity index equals 0. In the two characters are aware of users and the surrounding environ- 
previous occurrences, in step 110 it is determined that the ment. In particular, characters are aware of the age and 
count is not less than or equal to 0 and, hence, the tip is not 50 gender of the user and may be aware of additional user 
displayed. If the count is greater than 0, the tip is displayed information derived from user tracking software. For 
(step 111). instance, a character may refer to a female user as "Mme." 

The tip is displayed by the tracking service 105 teUing the and may refer to a male user as "Sir". Characters are also 

tip service 104 to display the tip. The tip service 104 aware of their surrounding environments so that they are 
provides requisite information to the application 28 to 55 aware of current date and time. For example, if a user logs 

display the tip in the speech balloon. As mentioned above, in during the morning, the character may greet the user with 

data structures for the tip are provided on a per-application "Good morning". In contrast, if the user logs on in the 

basis. It should be appreciated that the tips may be applied evening, the character may greet the user with "Good 

across application boundaries. For instance, certain tips may evening". As a further example, certain actions that a 
be applicable to different applications. Accordingly, the tip 60 character performs may be triggered by timing. For 

may be applied across application boundaries. example, a character may be developed so as to produce a 

The services 26 that are provided in the software devel- speech balloon that says "Time for lunch" when the clock 

opment platform 24 (FIG. 1) also include actor services for reads 12 noon. 

animating the characters. FIG. 11 A shows the components Through the use of personal and speciaUst characters, the 
that play a role in playing such animations, and FIG. IIB 65 preferred embodiment of the present invention makes the 

shows a flow chart of the steps performed to play such an user interface of the shell much more easy to use. These 

animation. Initially, an application 28 sends a command 114 characters are especially well adapted to be used by novice 
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users without the need for extensive training. Moreover, 
these characters are consciously designed to be non- 
intimidating to users. As such, users feel more at ease using 
the software platform of the preferred embodiment than 
using conventional software products. 

The above discussion has focused on characters and their 
use within the preferred embodiment of the present inven- 
tion. The discussion below focuses on the home user inter- 
face provided by the shell 30 (FIG. 1) of the preferred 
embodiment of the present invention. 

The shell 30 provides the user with the ability to log on 
and gain access to the rooms that constitute his "home". FIG, 

12 is a flow chart of the steps that are performed during a 
log-on sequence in the preferred embodiment of the present 
invention. Initially, an outside screen depicting a front door 
of the home of a user is shown on the video display 16 (step 
119 in FIG. 12). When the user clicks the mouse 18 when a 
cursor is anywhere on the screen that depicts the front door 
of the home, a log-on balloon is displayed as shown in FIG. 

13 (step 120). The log-on balloon includes a list of options 
where the user can specify whether he is a new user or not 
(see step 121 in FIG. 12). If the user is not a new user, a 
balloon is displayed that contains an edit box for requesting 
a password (step 122). After the user has entered the 
password, a determination is made whether the user entered 
the correct password or not (see step 124), If the user did not 
enter the correct password, an error balloon is displayed 
(step 126), and then the user is requested to again enter his 
password (step 122). If, instead, the user enters the correct 
password, it is determined whether the user has logged on 
previously or not (sec step 128). If the user has logged on 
previously, the last room that the user was in is displayed on 
the video display 16 (step 132 in FIG. 12). On the other 
hand, if this is the first time the user has logged on, a default 
room of the home (e.g., the study) is displayed on the video 
display 16 (step 130 in FIG, 12). 

If in step 120, it is determined that the user is a new user, 
the steps shown in FIG. 14 are performed. Initially, text is 
displayed that welcomes the user (step 134 in FIG. 14). The 
sheU 30 then displays check boxes and fields for the user to 
complete (step 136). The user selects check -boxes and enters 
requested information in the fields. A password edit box is 
then displayed (step 138). The user enters the proposed 
password into the edit box. A confirmation password edit 
box is subsequently displayed to confirm the password that 
the user has entered (step 140). If the user enters a different 
password than he first entered (see step 142), the confirma- 
tion edit box is again displayed (see step 140). In contrast, 
if the user enters the correct password, descriptive informa- 
tion about the home user interface is displayed (step 144). 
Lastly, the user enters the home and is shown the default 
room of the home (step 146). 

The home that is provided by the software development 
platform 24 (FIG. 1) is a series of rooms which are con- 
nected to each other via passageways. The passageways 
provide a mechanism for a user to move between the rooms 
of the home. Passageways may be doors or other types of 
passageways. FIG. 15 depicts the rooms that arc included in 
a typical house in accordance with the preferred embodi- 
ment of the present invention. The home shown in FIG. 13 
includes an attic 148, a study 150, a conservatory 152, a 
workshop 154, a kitchen 156, a family room 158 and a kids 
room 158. The home also includes the inside of a safe 162, 
the inside of a drawer 164 and the inside of a mouse hole 
166. The darkened arrows shown in FIG. 13 indicate door- 
ways that connect the rooms. The lighter arrows indicate 
passageways that are not doorways. 
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When a room is displayed, the room occupies the full 
screen of the video display 16. Each room contains walls, a 
ceiling, a floor and a set of objects. The walls cannot be 
moved or resized. '^The nature of the room determines which 

5 objects are included in the room by default. For example, 
study 150 includes a desk and a lamp. Rooms cannot be 
changed into other types of rooms. For example, a kitchen 
cannot be changed into a family room. Rooms can be added 
and deleted from the home. As will be described below, the 

10 shell 30 provides a vehicle for making such changes. 

Rooms are made up of walls, a ceiling and a floor. Objects 
are placed on the waUs and floor of the room. All objects 
other than the walls, the ceilings and the floors can be moved 
within the room and can be resized. FIG. 14 shows an 

15 example of a study 32 that includes these elements. 

The sheU 30 (FIG. 1) provides a default home style. The 
default home style is the contemporary home style. The 
home style dictates the appearance of objects within the 
respective rooms of the home. In the preferred embodiment 
of the present invention, four home styles are available. 
These home styles are: contemporary, castle, retro- and 
post-modem. 

Each window in the home has an outside view. Anima- 
tions may be provided as part of this outside view or static 
images may be provided. For example, a window may show 
an outside view of the ocean, scenes from Paris or scenes 
from a desert. 

To help illustrate the difference between home styles, 
FIG. 16 shows a study in the castle home style. The study 
shown in FIG. 16 may be contrasted with the contemporary 
study shown in FIG. 2. Each of the studies contains many of 
the same objects, but the appearance of the objects differ 
according to the style. 

35 A user may change the style of a room. The sheU 30 
provides a balloon that provides a user the option of chang- 
ing the style of the room. The entire style of a house may be 
changed by changing the style of each of the rooms to the 
desired new style. 

40 FIGS. 17 A and 17B illustrate the change in appearance of 
objects when the style of the room is changed from con- 
temporary to a space style. FIG. 17 A shows a couch 168, a 
balloon 170 and a coffee table 172 for a room in the 
contemporary home style. When the style of the room is 

45 changed to the space style as shown in FIG. 17B, the 
appearance of the couch 168' is changed, as is the appear- 
ance of the coffee table 172'. The appearance of the balloon 
170, however, does not change. This is because there is no 
new image for the balloon in the new style. In changing 

50 room styles, the preferred embodiment of the present inven- 
tion changes the style of each object that has an image in the 
new style, but it does not change an object that does not have 
an image in the new style. 
The default home includes a default set of rooms and a 

55 default location for objects within each room. Each room has 
at least one passageway. The door 174 shown in FIG. 15 is 
an example of a passageway. A passageway is a special kind 
of object that when clicked on (i.e., when the cursor points 
to the object and the mouse button is quickly pressed and 

60 released) presents the user with a balloon. The balloon 
provides the option to jump to a specified room or to change 
the passageway. If the user wishes to go straight to the 
passageway to the new room, the user double clicks on the 
passageway. 

65 ITie objects provided in each room are of three varieties: 
passive objects, active objects and passage-way objects, llie 
passage-way objects have been discussed above. Passive 
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objects are objects that are shown in a room merely for 3. The method of claim 1 wherein the step of outputting 

decorative purposes and do not provide a mechanism for information to assist the user via the animated character 

activating an application or moving to a new room. Active when running the software development platform that dis- 

objecls provide extended properties and allow a user to plays a system user interface comprises the step of display- 

mvoke an appUcation. Table 176 is an example of a passive 5 ing textual help information on the video display, 

object. Calendar 178, in contrast, is an example of an active 4^ ^^^^^^ ^laim 1 wherein the data processing 

object. The user positions the mouse on the calendar, double t^^, ^^^^^^^^ ^^^^^ ^^^^ 

ciicKs and ine calendar program is invoiced ^ outputting information to assist the user via the animated 

The objects may include their own code for handlmg the ^hen running the software development platform 

display of the objects, for handlmg the userinterface for the +u«f i« ,^ • * _f • .1, * r 

object and for providing additional fiinctionaUty for the '° 'hat ispUys a sys em user mterface comprises the step of 

object. For example, a cellular phone object might be ou pu ting audio mformation to assist the user over the audio 

provided that follows the user from room to room. The , ^ , . - , 

cellular phone object flashes a light when the user has . ^® ^^^^^^ ^^^^^ ^ wherein the step of outputting 
received voice mail and presents a custom baUoon that lets information to assist the user via the animated character 
you listen to messages or speed dial numbers when the running the software development platform that dis- 
object is clicked upon. plays a system user interface comprises the step of present- 
It should also be appreciated that objects may be animated ^^^^ "^^^ controls on the video display for perform- 
just like characters. Such animations may include sounds, tasks. 

commands and conditional branching as described above for 6- ^h^ method of claim 1 wherein the step of outputting 

the characters. The more traditional objects are merely still 20 information to assist the user via the animated character 

images. when mnning the selected one of the application programs 

Those skilled in the art will appreciate that the real world comprises the step of displaying an animation of the ani- 

metaphor adopted by the preferred embodiment of the mated character on the video display, 

present invention may be extended to provide alternative 7. The method of claim 1 wherein the step of outputting 

user interfaces that differ from the home interface. For 25 information to assist the user via the animated character 

example, the interface may resemble a town or city, when mnning the selected one of the application programs 

The preferred embodiment of the present invention pro- comprises the step of displaying textual help information on 

vides a user interface that is easy to use, non-threatening and the video display. 

helpful. Users readily accept the home metaphor provided 8. The method of claim 1 wherein the data processing 

by the user interface. The characters provided in the pre- 30 system includes an audio output device and wherein the step 

ferred embodiment act as friendly centrahzed services of of outputting information to assist the user via the animated 

assistance. character when running the selected one of the application 

While the present invention has been described with programs comprises the step of outputting audio information 

reference to a preferred embodiment thereof, those skilled in to assist the user over the audio output device, 

the art will appreciate that various changes in form and detail 35 9. The method of claim 1 wherein the step of outputting 

may be made without departing from the intended scope of information to assist the user via the animated character 

the present invention, as defined in the appended claims. when mnning the selected one of the application programs 

What is claimed is: comprises the step of presenting the user with controls on the 

1. In a data processing system having a video display, a video display for performing tasks. 

storage for storing computer programs, a processor for 40 10. In a data processing system having a storage, and a 

running the computer programs including application pro- video display, a method comprising the steps of: 

grams and a software development platform, the software providing a software development platform, which is a 

development platform being a hybrid between a software hybrid between a software suite and an operating 

suite and an operatmg system havmg a service for displaying ^y^tem that provides services caUable by a software 

on the video display at least one animated character created 45 development platform component, that displays a sys- 

by the service for use by application programs, wherein the t^m user interface on the video display, the system user 

software development platform displays a system user interface including mechanisms for invoking a plurality 

mterface, said system user interface mcluding mechanisms of application programs; 

for invoking the application programs, a method comprising , . . . . . 

the steps of* ^ t. displaying a personal character on the video display for a 

. f • 4U J 1 * 1 *r . to provide assistance to the user in using said 

as part or runmng the software development platform that • * _f j *i . r ^ i- 

5. I , • . ^ .1. system user interface and at least one of said apphca- 

displays the system user mterface on the processor, ^-^^ rams- and 

displaying the animated character on the video display programs, an 

via the service- storing at least one animation of the personal character in 

outputting information to assist a user via the animated 55 storage. 

character; as part of running a selected one of the method of claim 10 ftirther comprising the steps 

application programs on the processor, 

displaying the animated character on the video display retrieving the animation of the personal character from the 

via the service; and storage; and 

outputting information to assist the user via the ani- 60 displaying the animation on the video display. 

mated character. 12. The method of claim 10 wherein the step of storing at 

2. The method of claim 1 wherein the step of outputting least one animation comprises the step of storing audio data 
information to assist the user via the animated character in the storage as part of the animation. 

when running the software development platform that dis- 13. The method of claim 10 wherein the step of storing at 

plays a system user interface comprises the step of display- 65 least one animation of the personal character in the storage 

ing an animation of the animated character on the video comprises the step of storing multiple animations of the 

display. personal character in the storage. 
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14. In a data processing system having a video display, a 
method comprising the steps of: 

providing a software development platform, which is a 
hybrid between a software suite and an operating 
system that provides services callable by a software 
development platform component, that displays a sys- 
tem user interface on the video display, the system user 
interface including mechanisms for invoking a plurality 
of application programs; 

providing a personal character for a user that is displayed 
on the video display to assist the user in using the 
system user interface and at least one of said applica- 
tion programs; 

providing an animation for the personal character that 
may be played on the video display, said animation 
including multiple frames having a first branch of 
frames and a second branch of frames; 

receiving a request to play the animation; 

determining a state of a condition to ensure that one 
animation is not played repeatedly; 

based upon the determination of the state of the condition, 
determining which of the first branch and the second 
branch to play on the video display; and 

playing the determined branch. 

15. The method of claim 14 wherein the step of deter- 
mining the stale of the condition comprises the step of 
determining a random value, 

16. The method of claim 14 wherein the step of deter- 
mining the state of the condition comprises the step of 
determining a current measure of time. 

17. In a data processing system having a video display, a 
method comprising the steps of: 

providing a software development platform that displays 
a system user interface on the video display, the system 
user interface including mechanisms for invoking a 
plurahty of application programs; 

providing an animated personal character for a user that is 
displayed on the video display to assist the user in using 40 
the system user interface and at least one of said 
application programs; 

invoking a specialized task; and 

replacing the personal character with an animated spe- 
cialized character that is displayed on the video display 45 
and that provides assistance to the user as to the 
specialized task, wherein the specialized character has 
a personality associated with the specialized task. 

18. In a computer system having a processor, a storage, 
and a video display, a method comprising the steps of: 

providing a software development platform that displays 
a system user interface on the video display, the system 
user interface including mechanisms for invoking a 
plurality of application programs; 
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providing an animated character facility for execution on 
the processor for providing an animated character to 
assist a user in using the system user interface and at 
least one of said application programs; 

providing an application program for execution on the 
processor; 

maintaining context information that describes a current 
context in the storage, said context information includ- 
ing information about a current user; 
executing the application program on the processor; and 
based on the current context, determining an appearance 
for the animated character on the video display and 
displaying the animated character on the video display 
with the determined appearance. 

19. The method of claim 18 wherein the context infor- 
mation includes a current time and the step of determining 
the appearance of the animated character is based on the 
current lime. 

20. The method of claim 18 wherein the context infor- 
mation includes a current date and the step of determining 
the appearance of the animated character is based on the 
current date. 

21. The method of claim 18 wherein the determined 
appearance of the animated character comprises an anima- 
tion of the animated character. 

22. The method of claim 18 wherein the determined 
appearance of the animated character comprises a speech 
balloon for the animated character. 

23. In a computer system having a storage and a video 
display, a method comprising the steps of: 

providing a software development platform that displays 
a system user interface, said software development 
platform including an animation character facility for 
displaying animations of animated characters on the 
video display for assisting a user in operating the 
system user interface and a plurality of applications, the 
system user interface including mechanisms for invok- 
ing the plurality of application programs; 

encapsulating code and data for each character into a 
separate object, a selected one of said objects for a 
selected character including code for tracking user 
actions; 

executing the code for tracking user actions in the selected 
object to track actions by the user; and 

based on the actions by the user that have been tracked by 
the code for tracking user actions in the selected object, 
determining what animation of the selected animated 
character to display on the video display with the 
animated character facility. 
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